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LIGHT EMITTING STYLUS AND USER INPUT DEVICE USING SAME 

5 

This invention relates to a light emitting stylus and the use of a light emitting stylus in 
a user input device. 

Background 

Touch sensors have become an increasingly common way for users to intuitively 
10 interact with electronic systems, typically those that include displays for viewing information. 
In many applications, the information is viewed through the touch-sensitive area so that the 
user seems to interact directly with the displayed information. Depending on the technology 
of the input device, a user may interact with the device using a finger or some other touch 
implement such as a stylus. When a stylus is used, it can be a passive object (as is typical for 
15 those used with resistive touch screens, for example in a personal digital assistant or other 
hand-held device) or an active object (as is typical for those used with signature capture 
devices). An active stylus can communicate signals with the input device, whether sending, 
receiving, or both, to determine touch position or other information. Active styli include those 
that send or receive radio frequency signals (RF pens), those that use magnetic fields for 
20 inductive signal capture (inductive pens), and those that emit or receive light (light pens). 

Summary of the Invention 

The present invention provides a light-sensitive user input device that includes a co- 
planar array of light-sensitive devices disposed to sense light transmitted through an input 
25 surface of the input device, nearest adjacent light-sensitive devices having a center-to-center 
spacing that is no more than a maximum distance, and a stylus configured to emit a light beam 
detectable by the devices, the light beam exhibiting a cross-sectional profile having a known 
shape characterized by an intensity variance across the beam profile. The light beam exhibits 
a size at the plane of the devices that is greater than the maximum distance when the stylus is 



1 



contacting the input surface. The input device also includes electronics coupled to the devices 
and configured to determine the position of the light beam to within a spacing that is less than 
the maximum distance. 

The present invention further provides a method of determining the position of a light 
5 beam at an input surface. The method includes providing a co-planar array of light-sensitive 
devices disposed to sense light transmitted through the input surface, emitting the light beam 
with a known shape characterized by a cross-sectional profile having a known intensity 
variance, the light beam having a spot size sufficient for the light beam to be detected by at 
least two of the light-sensitive devices when the light beam is directed through the input 
10 surface. The method also includes detecting the light beam by at least two of the light- 
sensitive devices, and determining the position of the light beam to an accuracy that is less 
than the center-to-center distance between nearest adjacent light-sensitive devices by 
interpolating signals measured during the detecting step using the known intensity variance of 
the light beam. 

15 The above summary of the present invention is not intended to describe each disclosed 

embodiment or every implementation of the present invention. The Figures and the detailed 
description that follow more particularly exemplify these embodiments. 

Brief Description of the Drawings 

The invention may be more completely understood in consideration of the following 
20 detailed description of various embodiments of the invention in connection with the 

accompanying drawings where the use of identical reference numerals in different Figures 
denotes substantially the same, but not necessarily identical element, and in which: 

Figure 1 schematically shows a side view of a user input device used according to the 
present invention; 

25 Figure 2 schematically shows a plan view of the device shown in Figure 1 ; 

Figure 3 schematically shows a side view of another user input device used according 
to the present invention; 

Figure 4(a) shows intensity profiles of various representative light beams; 
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Figure 4(b) shows the cross-sectional beam intensity profile of one of the light beams 
indicated in Figure 4(a); 

Figure 5 schematically shows a plan view of the device shown in Figure 3; 

Figure 6 schematically shows a side view of another user input device used according 
5 to the present invention; 

Figure 7 schematically shows a plan view of the device shown in Figure 6; 

Figure 8 shows a block diagram of a user input system of the present invention; and 

Figure 9 schematically shows a side view of another user input device used according 
to the present invention. 
10 While the invention is amenable to various modifications and alternative forms, 

specifics thereof have been shown by way of example in the drawings and will be described in 
detail. It should be understood, however, that the intention is not to limit the invention to the 
particular embodiments described. On the contrary, the intention is to cover all modifications, 
equivalents, and alternatives falling within the spirit and scope of the invention. 

15 Detailed Description 

The present invention relates to a light emitting stylus, the position and states of which 
can be measured by an optical digitizer. Light beam size and shape can be adapted to provide 
accurate, high resolution location determination using an array of light sensors. 

The present invention provides a light emitting stylus useful in a user input device, 

20 where the stylus can include one or more of the following features. The present invention 
provides a stylus that emits a light beam having a spot size that is greater than the distance 
between neighboring adjacent optical sensors to locate the beam at all locations of interest. 
The present invention provides a stylus that emits a known, varying intensity profile, such as 
with a slightly defocused light beam having an intensity profile that is brightest at the center 

25 and reduces to zero in a known pattern. In using such a stylus, two or more adjacent optical 
sensors can detect light in an amount proportional to their proximity to the center of the beam, 
thus allowing interpolation of the location of the beam center resulting in a greater resolution 
than would be expected given the distance between optical sensors. The present invention 
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provides a system in which the angle of the light beam, and therefore the angle of the stylus, 
can be measured using the aspect ratio of the beam shape at the plane of the light sensors in 
comparison with the known aspect ratio of the beam. This angle, and the location of the 
center of the beam, can be used to locate the position of the stylus. This may be particularly 
5 useful when the digitizer surface is a significant distance from the light sensing surface to 

account and correct for parallax errors. Knowing the position of the stylus, and thus the user's 
hand, can also be useful for other purposes such as determining where to display information 
so that it can be seen by the user. 

FIG. 1 shows an input device 10 that includes a digitizer 1 1, which may include an 

10 upper substrate 15 having an input surface 16, a lower substrate 18, a photo detector array 19 
including detectors 48, and inter-substrate gap 17. Digitizer 1 1 may also function as a display, 
for example an active matrix liquid crystal display (AMLCD) where the photo detectors are 
additionally provided, a liquid crystal display (LCD) where the photo detectors are the pixel 
transistors of the display, an organic electroluminescent display (OLED) where the light 

15 emitting pixels also function as photo detectors, and the like. Examples of digitizers suitable 
for use in the present invention include those disclosed in the following publications, each of 
which is wholly incorporated into this document as if reproduced in full: WO 03/071345; 
WO 03/058588; U.S. Pat. 6,337,918; U.S. Pat. 5,838,308; JP 10-187348; JP 10-2831 13; JP 
58-086674; JP 60-198630; JP 60-200388; JP 61-006729; JP 61-075423; JP 1 1-282628; and 

20 JP 2003-66417. 

FIG. 1 also shows two identical light emitting styli 20 and 21, each emitting highly 
focused laser-like beams 30 and 31, respectively. Styli 20 and 21 are a distance T from array 
19. Stylus 20 is perpendicular to array 19, and the width of its beam 30 is sufficient to 
irradiate at least two photo detectors simultaneously. The location of stylus 20 can be 

25 determined by measuring the position of the spot of light intersecting with detector array 19 
directly below stylus 20. Detection of light beam 30 may be enhanced by modulating beam 30 
so the detected signal can be filtered and separated from ambient light or electronic noise. 
Light beam 30 may be modulated by changing color, intensity, duty cycle, polarization, or 
pulse width modulation without affecting the position measurement. Such beam modulation 



4 



may also be used to convey states of the stylus, such as the on/off condition of a tip transducer 
24 (e.g., indicating contact of the stylus with the input surface), or side switch 23. These 
states can be communicated via array 19 to measurement system 213 (see FIG. 8). Uniquely 
modulated beams from two or more styli may be used to distinguish the styli, for example 
5 those used by two or more unique users of a single digitizer. 

The side switch 23 and/or the tip transducer 24 can be pressure activated switches that 
make or break an electrical contact, resulting in a signal. The signal may be a change in stylus 
beam 30, such as a change in beam intensity, or in the duty cycle of a modulated beam 30, or 
in frequency of modulation of beam 30, or the color of beam 30, or the polarization of light in 
10 beam 30. The change in stylus beam 30 is conveyed via array 19 to measurement system 213 
where it may be interpreted as the equivalent of a right or left mouse click, or other change in 
status of stylus 20. 

Side switch 23 may be a capacitive sensing transducer that activates when touch 
contact is made to the body of stylus 20 and also to an electrically isolated area, identified as 

15 switch 23. Tip transducer 24 may be a pressure sensing transducer that outputs a continuously 
varying signal in response to varying pressure on tip transducer 24. The signal from 
transducer 24 can cause a change in stylus beam 30, such as a change in beam intensity, or 
frequency, etc. described above. 

Tip transducer 24 may be a mechanical shutter that passes a variable amount of light 

20 from a light source in stylus 20 to array 19, depending on the amount of pressure applied to tip 
transducer 24. Tip transducer 24 may be a light guide in the form of a movable lens or a tube 
that focuses or guides light to form a variable width beam from a light source in stylus 20 to 
array 19, depending on the amount of movement of tip 24, resulting from pressure applied to 
tip transducer 24. Width changes of the beam can be measured as described with respect to 

25 FIG. 5. 

Referring again to FIG. 1, stylus 21 and its beam 31 are identical to stylus 20 and beam 
30, except that stylus 21 is at an angle of A degrees with respect to an axis perpendicular to 
array 19. This angle and the distance T between stylus 21 and array 19 results in a distance E 
between the point of contact of stylus 21 with surface 16 and the point where light beam 31 
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intersects with detector array 19. If the location of stylus 21 were measured as the intersection 
of beam 31 and array 19, the distance E will represent an error. The error E can be measured 
and corrected if the angle A of stylus beam 3 1 can be measured, and the distance T is known 
(or can be measured). 

5 FIG. 2 shows an overhead view of the array 19 of photo detectors 48, spaced center-to- 

center at a distance M D horizontally and No vertically. As shown, No = Md, although this 
condition need not be the case. The present invention contemplates any array or distribution 
of light detectors, including linear arrays, hexagonal arrays, rectangular arrays, or any other 
suitable array or distribution of detectors. FIG. 2 is meant to represent a relatively high 

10 detector density such as is typical of OLED displays configured for optical sensing, such as 
disclosed in WO 03/058588, incorporated herein by reference. Also shown are light spots 40 
and 41 irradiated by stylus beams 30 and 31 respectively. A resolution of half the detector 
array 19 spacing (in this case M/2), can be achieved if a beam irradiates at least portions of 
two detectors simultaneously in each of the X and Y directions. Each photo detector in array 

15 19 measures multiple levels of light, so interpolation of light levels can be used to locate the. 
position of a spot having a diameter greater than 2M diameter to a resolution finer than the 
inter-detector distance M. In the case where N D and M D are not equal, it may be desirable 
for the spot diameter to be about equal to or greater than the larger of N D and Md- While 
beam spot 40 is shown to be round, it will be appreciated that any spot shape can be used, 

20 particularly when the spot shape and intensity distribution are known. 

Spot 41 is made by a round beam of light from stylus 21 that is oriented at an angle of 
A degrees from the plane of detector array 19. The resulting spot 41 is an elliptical shape with 
minimum width D, equal to the diameter of beam 31. The long dimension L of the ellipse is 
determined by the equation: 

25 

L = D * Cos A (Equation 1) 

So A can be calculated from L and D; 
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A = Cos' ! D/L 



(Equation 2) 



A stylus beam angle of 45° results in L = 1 .41 * D. The length to width ratio and 
orientation of the longer dimension of elliptical spot 41 can thus be used to measure the tilt 
5 angle A and tilt axis of stylus 21. Given the angle A from equation 2 and the known distance 
T, the magnitude of error E can be calculated by: 



elliptical spot 42, and therefore error E, can be determined directly from sensor array 19 
measurements and simple image recognition algorithms. The direction of error E, however, 
cannot be determined from direct, static measurement. For example, spot 41 may result from 
a stylus 21 at position Q, or at position W. The actual stylus position can be determined by 

15 applying one or more of several methods, examples of which are outlined below. 

Stylus 21 will typically be hand held, and thus the tilt angle A of stylus 21 will 
typically be in the direction of the hand or fingers holding the stylus. Since the user and hand 
are typically oriented toward the bottom of digitizer array 19, it may be assumed that the hand, 
and (generally) stylus 21 are located nearer to point W than to point Q. This method may be 

20 adequate in systems where the orientation of the input device with respect to a user will 
always be known. 

Since digitizer array 19 senses light, hand position may be determined by measuring 
the shadow 47 cast by stylus 21 and the hand or fingers, relative to light spot 31. A shadow 
49 to the right of spot 31 (as shown in FIG. 1), indicates that stylus 21 is located nearer to 
25 point W than to point Q. This method may be adequate in systems where there is sufficient 
ambient light to cast a shadow from the stylus or the hand. 

It is also possible to infer the hand location based on spot movements. In normal 
writing, few strokes (especially straight strikes) are made by pushing the stylus in the direction 
it is pointing. Most strokes will be made sideways or by pulling the stylus tip in the direction 



E = Tan A * T 



(Equation 3) 
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The magnitude of error E can be calculated from Equation 3. The long axis L of 
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the stylus is tilted. Thus, a recent history of relative beam locations can be used to determine 
hand position. 

A further method includes prompting the user to indicate hand position and/or device 
orientation prior to user inputs being made. 
5 A further method of determining stylus orientation includes additional analysis of the 

light distribution of the spot formed on the detectors. Without loss of generality, in the case in 
which a light beam having a know cross-sectional intensity distribution, such as a Gaussian 
light distribution or a conical light distribution, illuminates the sensor array at an angle, an 
elliptical spot will be formed such as spot 41 in FIG. 2 (and, analogously, as shown in FIGs. 5 

10 and 7 with respect to spots 141 and 341, respectively). The elliptical spot will generally 
exhibit an intensity distribution such that the half of the spot oriented toward the stylus tilt 
direction will have a higher integrated intensity than the half of the spot oriented away from 
the stylus tilt direction. As such, comparing the integrated intensity contribution from 
different halves, quadrants, or other selected sections of the spot can be used to indicate stylus 

15 tilt direction. 

In addition to aiding positional error corrections, hand and stylus position information 
can be used for other purposes. For example, when popping up a menu or other information 
on the display, it may be desirable to position the information where its viewing is unlikely to 
be blocked by the stylus or hand. As another example, in multiple user systems, the 

20 determined position and orientation of the stylus can be used to determine which user is 
inputting the information. 

FIG. 3 shows an input device 1 10 similar to device 10 shown in FIG. 1, except that 
styli 120 and 121 emit conical beams, spreading light in spot patterns over a wider area. Also, 
sensor array 1 19 has fewer detectors 148 that are more widely spaced, as may be the case 

25 where the photo detectors 148 are part of a photo-sensitive LCD, as disclosed in International 
Publication WO 03/071345, which is hereby incorporated by reference. In a sparse array such 
as 1 19, a wider beam with a known varying intensity across its axis has advantages as 
discussed below. 



FIGs. 4(a) and (b) can be used to demonstrate various representative beam intensity 
profiles. FIG. 4(a) shows chart 100, with light distributions of several light beams shown. 
The distribution of radiant intensity around a light source (e.g. an LED) is referred to as the 
beam angle O. The maximum radiant intensity is on the optical axis. This is generally 
5 reduced as the angle O to the optical axis increases. The range of the optical angle within 

which the radiant intensity is greater than or equal to 50% of the maximum value is referred to 
as the half intensity value. 

Referring to graph 100, line 101 results from a sharply focused laser-like beam with a 
half intensity angle near zero. Line 102 is typical of an unfocused, planar type LED, with a 
10 half intensity angle of +/- 60°. Line 103 may be achieved with a parabolic lens on an LED, 
resulting in a half intensity angle of +/- 25°. Graph 90 in FIG. 4(b) shows another view of line 
103, the relative radiant intensity of a light source with half intensity angle of 25°. Such a 
known beam intensity profile can be used as described in discussions that follow. 

Referring back to FIG. 3, consider that the beam of stylus 120 has the radiant versus 
15 angle as indicated by profile 103 in FIGs. 4(a) and (b). This results in light distribution onto 
array 1 19 that varies with distance from a maximum light at the beam 130 center, reducing 
with distance from the center in a known way. When used with a sparse array such as array 
1 19, this light distribution has several advantages over highly focused beams 30 and 31, 
shown in FIG. 1. Because the intersection of beam 130 with array 1 19 is wider, the light 
20 irradiates several detectors 148 even though their spacing is wide. The light distribution has a 
defined pattern, which may be used to more accurately interpolate between widely-spaced 
detectors 148. Also, changes in distance between stylus 120 and array 1 19 will result in a 
change in width of the intersection of beam 130 and array 119 that may be detected. This may 
allow stylus 120 height (distance from array 1 19) to be measured. 
25 FIG. 5 shows a top view of array 1 19 and light spots 140 and 141 irradiated by stylus 

beams 130 and 131, respectively. Inter-detector spaces are M s horizontally and N s vertically, 
where M s = N s . G represents the width of the minimum gap between adjacent photo detectors 
148. Spot 42 is an example of a spot that might be made by a small diameter, more sharply 
focused laser-like beam. If spot 42 diameter is less than or equal to the inter-detector gap G 



9 



(as shown), it can be located by detectors in array 1 19 with a resolution determined by the 
inter-detector distance M. If spot 42 diameter is greater than the inter-detector gap G, it can 
be measured simultaneously by two detectors 140, and interpolation can be used to locate spot 
42 with a resolution of M/2. The inter-detector spacing M of sparse array 1 19 may be greater 
5 than 1 mm, so a resolution of M/2 would be marginal for some stylus applications such as 
writing. Therefore a wider, variable-intensity spot like 140 can be generated so interpolation 
can be used more effectively. 

Referring again to FIGs. 3 and 5, consider spot 140 having a light distribution as 
defined by profile 103 shown in FIGs. 4(a) and (b), and spot 140 is centered half way between 

10 detectors 142 and 143. Given M = N = 1 mm, and T = 3 mm, detectors 142 and 143 will 
receive about 0.94 of the maximum light transmitted to the plane of the detectors. Detectors 
144 and 145 will receive about 0.66 of maximum, or 70% as much as detectors 142 and 143. 
Detectors 146 and 147 will receive virtually no light. These light intensities and intensity 
differences among adjacent detectors allow high resolution interpolation between the detectors 

15 in that the beam intensity profile and overall shape are known and can be compared to the 
detected signals. The detected signals can be mapped onto the known profile and shape to 
pinpoint the location of the center of the beam. 

Elliptical spot 141 results from stylus 121, at an angle A2 with respect to array 1 19. 
Length to width ratios can be used to calculate the orientation and angle of stylus 121, and the 

20 error E2, using methods similar to those described above in terms of stylus 21 and elliptical 
spot 41. Error E2 may also be further analyzed. A beam with light distribution as defined by 
profile 103 will distribute light with half of total irradiation on either side of the optical axis 
(and stylus axis). The irradiation falling in the direction of stylus tilt will fall in a smaller area 
that spans length E2, while the irradiation on other side of the optical axis will cover a larger 

25 area. The total illumination in the region of spot 141 collected by detectors 148 may be 
analyzed to determine the location of the optical axis, based on a 50%/50% distribution. 
Alternatively, the optical axis may be located by comparing the measured light distribution of 
spot 141 versus the known light distribution profile (e.g., profile 103 in FIG. 4(b)). 
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FIG. 6 shows an input device 310 including digitizer 311. Two identical light emitting 
styli 320 and 321 are also shown, each emitting focused beams 330 and 331 with an annular 
beam pattern. Stylus 320 is shown in cross section, showing internal light source 335, and the 
cross section of tubular shaped light guide 336, which carries light from source 335 through 
5 tip 324, focusing it into an annular pattern of light. Stylus 321 projects a similar light pattern 
at an angle A3. 

FIG. 7 shows an overhead view of array 319 of photo detectors 348. Also shown are 
ring shaped light spots 340 and 341 irradiated by stylus beams 330 and 331, respectively. The 
ring-shaped spot 340 has the advantage that it can be formed of a relatively highly focused 

10 beam while exhibiting high contrast in light level, and thus in signal, between adjacent 
detectors. This contrast can be detected on both the inner and outer edges of the ring. For 
example, detector 350 will detect low light, while the eight nearest neighbor detectors 
adjacent to 350 will detect higher light levels, and the next group of detectors outward from 
the eight detectors will detect low light. Image detection algorithms can be used to resolve the 

15 stylus location with high resolution. The height of stylus 330 may also be measured using a 
ratio of ring diameter to center (unlit) diameter. The tilt angle and axis of elliptical ring 
shaped spot 341 can be determined as described above for spot 41 in FIG. 2. 

Hand shadow 349 and stylus shadow 347 can be used to determine the tilt angle A of 
stylus 321. In situations where spot contrast is low, shadows 349 and 347 can also be used in 

20 conjunction with spot 341 to locate the stylus. 

The spot intensity profiles shown and discussed are illustrative and not meant to be 
limiting. Other known, varied spot intensity profiles can be used in addition to those shown in 
the drawings, and are fully contemplated for use with the present invention as will be 
appreciated by those of skill in the art from the description provided in this document. The 

25 techniques for spot location determination and enhanced resolution, beam angle 

determination, stylus orientation determination, and so forth, as described are directly 
applicable to any spot intensity profile having characteristics detectable by light sensor arrays 
useful in the present invention. 
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FIG. 8 shows a block diagram of a display system with a photo detector array. 
Generally, the display pixel array 210 and the photo detector array 212 are co-located as 
described in published U.S. Patent Application US 2003/0122749 and in International 
Publication WO 03/071345, each of which is hereby incorporated into this document as if 
5 reproduced in full. Pixel drivers 211 and the photo detector measurement system 213 may 
also be integrated into the same semiconductor device(s), and may be in communication with 
system controller 218. Display pixel drivers 21 1 are known in the art. Photo detector 
measurement system 213 can measure the amount of light irradiating each detector in display 
pixel array 210. It may also be able to measure ambient light and to discriminate between 

10 ambient light and shadows. A system controller calculates display information to be sent to 
pixel drivers 211, and also calculates the position of light patterns on photo detector array 212, 
measured by photo detector measurement system 213. 

FIG. 9 shows a cross sectional view of system 410 with digitizer 41 1 having detector 
array 419. Each detector 448 in array 419 has an associated lens, for example lenses 452, 453, 

15 454, 455, 456, and 457, in its optical path. A similar lens arrangement is disclosed in U.S. 
Patent No. 6,028,581, which is incorporated by reference herein. Lenses 452 through 457 
focus light from above digitizer 411 such that each detector in array 419 receives light 
nominally perpendicular to array 419, through a column equal in diameter to lenses 452 
through 457. Light 431 from stylus 421 is spread in a wide angle, for example 170 degrees, so 

20 it is spread across many detectors, and may strike the detectors at various angles as indicated 
in Figure 9. Lenses 452 through 457 convey perpendicular light to their respective detectors, 
so only the light impinging on lenses 455 and 456 would be focused onto any detectors. Thus, 
the error E4 between the tip location of stylus 421 and the center of its emitted light spot, due 
to angle A4 of the stylus, can be reduced. 

25 A lens above each detector in array 419 can also increase the contrast of light and 

shadows received by detectors in array 419, because light impinging on surface 416 of 
digitizer 41 1 at oblique angles will be refracted by the lenses away from detectors in array 
419. This is particularly important where shadows, such as those cast by the stylus or hand as 
described in this document, are used to locate stylus and/or touch positions. 
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The present invention should not be considered limited to the particular examples 
described above, but rather should be understood to cover all aspects of the invention as fairly 
set out in the attached claims. Various modifications, equivalent processes, as well as 
numerous structures to which the present invention may be applicable will be readily apparent 
5 to those of skill in the art to which the present invention is directed upon review of the instant 
specification. 
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